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IN THE UNITED STATES 
PATENT AND TRADEMARK OFFICE 

APPLICANTS: Ted E. Dunning and Bradley D. Kindig 

APPLICATION NO.: 09/846,823 

FILING DATE: April 30, 2001 

TITLE: Relationship Discovery Engine 

EXAMINER: Not yet known 

GROUP ART UNIT: 2165 

ATTY. DKT. NO. : 22227-04647 



CERTIFICATE OF FACSIMILE TRANSMISSION 

I hereby certify chat this correspondence is being sent via facsimile transmission to the U.S. Patent and Trademark Office ai 
facsimile number (703) 605-0586 (Attn.: Examiner Luu) and addressed to: Commissioner for Patents, Washington, D.C 
2023 1 , on the date printed below: 

Dated: March 20. 200J B T- — /Qt'^^^ m Mfk — ^~ 

~~~~ Amir H. RaSltftogel. Reg. No, 37,070 



COMMISSIONER FOR PATENTS 
WASHINGTON. D.C. 20231 

SECOND SUPPLEMENTAL 
PETITION TO MAKE SPECIAL 

SIR: 

In response to the Decision on Petition to Make Special, which was mailed on October 8, 
2002, Applicants are hereby filing a Second Supplemental Petition to Make Special which 
specifies that the discussion is related to the references deemed most closely related to the subject 
matter. 

We previously submitted a fee transmittal, in duplicate, with our Supplemental Petition to 
Make Special dated October 23, 2003, which authorizes the U.S. Patent and Trademark Office to 
charge the required fees for the Petition to Make Special to our deposit account 19-2555. No 
additional fees are required. 
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Applicants hereby petition to make the above-referenced application special as described 
in MPEP §708.02 Vm. No examination has yet be en taken by an Examiner in this case. The 
claims are directed to a single invention. If the Office determines that all the claims presented 
are not obviously directed to a single invention, Applicants will make an election without 
traverse as a prerequisite to the grant of special status. 

A pre-examination search has been made with respect to the present invention by the 
professional searching company MetroPatent. The following classes and subclasses were 
searched: Class 709, subclass 23 1 . Additional search of EAST was conducted by Applicants' 
representatives. 

Pursuant to the provisions of 37 CFR 1.56 and 1.97-98, we previously submitted a 
modified form PTO-1 449 listing references for consideration by the Examiner- A copy of each 
of those references not already of record and deemed most closely related to the subject matter 
encompassed by the claims was sent with the original Petition to Make Special. Per Examiner's 
request, we are including with this Second Supplemental Petition to Make Special another copy 
of the Japanese reference No. JP2001202368. The inclusion of these references shall not be 
construed as a representation regarding the completeness of the list of references, or that 
inclusion of a reference in this list is an admission that it is prior art or is pertinent to this 
application, or as an admission that the information listed is, or may be considered to be, material 
to patentability, or that no other material information exists, and shall not be construed as an 
admission against interest in any manner. 

Detailed Discussion of the References 

Pursuant to the provisions of MPEP §708.02 VIII, the following is a detailed discussion 
of the references deemed most closely related to the subject matter listed in the previously 
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submitted modified form PTO-1449, which discussion points out, with the particularity required 
by 37 CFR 1.111(b) and (c), how the claimed subject matter is patentable over the references. 
Independent claim 1 recites: 

1. A computer-implemented method of discovering relationships between items, 
comprising: 

accepting item selections from a plurality of users; 

generating a log for each user, each log containing identifiers for the user's item 
selections; 

accepting a query including at least one query item identifier; 

scoring the user logs, responsive to a degree of occurrence of the at least one query 
item identifier in the user logs, to generate user log scores; and 

determining at least one result item, responsive to a degree of occurrence in at least a 
subset of the scored user logs. 



Independent claim 34 recites: 

34. A computer-implemented method of discovering a relationship between a first item 
and a second item, comprising: 

determining a total number of item groups N; 

determining a number of item groups Ni in a subset of item groups, the subset of item 
groups being defined as including those item groups that contain a second 
item; 

determining a number of item groups N 2 not in the subset of item groups; 
determining a number of item groups k n in the subset that contain the first item; 

22227/04647/DOCS/1336638.1 
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determining a number of item groups k 12 not in the subset that contain the first item; 
detenruning a number of item groups k 2 i = Ni - k M in the subset that do not contain 
the first item; 

determining a number of item groups k 22 55 N 2 - k P _ not in the subset that do not 

contain the first item; 
and detenruning a log likelihood ratio. 



Independent claim 39 recites: 

39. A system for discovering relationships among items, comprising: 
a user interface for accepting item selections from a plurality of users; 
at least one log database, coupled to the user interface, for storing a log for each user, 

each log containing identifiers for the user's item selections; 
a query input device for accepting a query including at least one query item identifier; 
and 

a recommendation engine, coupled to the log database and to the query input device, 
for scoring the user logs, responsive to a degree of occurrence, to generate user 
log scores, and for determining at least one result item, responsive to a degree 
of occurrence in at least a subset of the scored user logs. 

Independent claim 59 recites: 

59. A computer-readable medium comprising computer-readable code for discovering 
relationships between items, comprising: 

computer-readable code adapted to accept item selections from a plurality of users; 

22227/04 647/DOCS' 1 33663S. 1 
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computer-readable code adapted to generate a log for each user, each log containing 

identifiers for the user's hem selections; 
computer-readable code adapted to accept a query including at least one query item 

identifier; 

computer-readable code adapted to score the user logs, responsive to a degree of 
occurrence of the at least one query item identifier in the user logs, to generate 
user log scores; and 

computer-readable code adapted to determine at Jeast one result item, responsive to a 
degree of occurrence in at least a subset of the scored user logs. 



Independent claim 93 recites: 

93. A computer-readable medium comprising computer-readable code for discovering a 
relationship between a first item and a second item, comprising: 

computer-readable code adapted to determine a total number of item groups N; 
computer-readable code adapted to determine a number of item groups Ni in a subset 

of item groups, the subset of item groups being defined as including those 

item groups thakcontain a second item; 
computer-readable code adapted to determine a number of item groups N 2 not in the 

subs et of item groups ; 
computer-readable code adapted to determine a number of item groups kj i in the 

subset that contain the first item; 
computer-readable code adapted to determine a number of item groups k| 2 not in the 

subset that contain the first item; 
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computer-readable code adapted to determine a number of item groups k:i = N ( - ki i 

in the subset that do not contain the first item; 
computer-readable code adapted to determine a number of item groups k22 = N 2 - ki2 

not in the subset that do not contain the first item; and 
computer-readable code adapted to determine a log likelihood ratio. 

The present invention provides a recommendation engine and application capable of 
discovering relationships among items and recommending items without requiring undue effort 
on the part of the user. The recommendations provided by the present invention are based on 
user profiles that take into account actual preferences of users, without requiring users to 
complete questionnaires. The present invention provides improved data analysis by avoiding 
inaccurate assumptions regarding distribution of user preferences. In particular, the present 
invention employs a binomial log likelihood ratio to provide improved analysis of data points 
describing user preferences. The invention thus provides improved recommendation generation, 
while avoiding the problems of overstatement of coincidences and dominance of bestsellers. 

The claims are directed toward several different variations of these recommendation 
. engine techniques. Claim 1 recites a method for discovering relationships by accepting item 
selections from a plurality of users, generating a log for each user, accepting a query including at 
least one query item identifier, scoring the user logs responsive to a degree of occurrence of the 
at least one query identifier in the user logs, to generate user scores. Claim 34 recites a method 
claim for discovering a relationship between a first and second item by determining a total 
number of item groups N, determining a number of item groups Ni in a subset of item groups, 
determining a number of item groups N2 not in the subset of item groups, detemiining a number 
of item groups kn in the subset that contain the first item, deteiniining a number of item groups 
ki2 not in the subset that contain the first item, deterrnining a number of item groups k2i = Npkn, 

22227/04647/DOCS/l 336638. 1 
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determining a number of item groups k 22 = N r ku, and determining a log likelihood ratio. Claim 
39 recites a system for discovering relationships using a user interface for accepting item 
selections from a plurality of users, at least one log database, a query input device for accepting a 
query including at least one query item identifier, and a recommendation engine for scoring the 
user logs. Claim 59 recites a computer program product corresponding to the method of claim I . 
Claim 93 recites a computer program product corresponding to the method of claim 34. 

U.S. Patent No. 6.065.058 to Hailnern et aL "Dynamic Pus h Filtering Based on Information 
Exchanged Among Nodes in A Proxy Heirarchv" 

Hailpern et al. is understood to disclose a method and system for filtering push 
information in a client-server hierarchy based on actual usage information. A pushed object is 
communicated down the hierarchy by communicating usage information up the hierarchy and 
filtering the pushed object based on the communicated usage information. Usage information 
can include actual object reference/access patterns. 

However, Hailpern et al. does not teach the invention of claims 1, 34, 39, 59, or 93 and in 
particular does not teach any technique for accepting a query. Rather, Hailpern et al. uses 
filtering to push an object to a user, and in fact solves a completely different problem than that 
addressed by the present invention. Hailpern et al. seeks to reduce network traffic caused by 
increased popularity of the world wide web. Specifically, Hailpern et al. teaches a push based 
filtering approach intended to avoid delays caused by increased traffic when a user requests a 
document. Hailpern et al. pushes objects through a client-server hierarchy without a request by 
the user. Thus, Hailpern et al. fails to disclose any technique for accepting a query as claimed 
herein, and in fact teaches away from accepting a query since push technology generally involve 

Furthermore, with respect to claims 34 and 93, Hailpern et al. does not teach any 
technique for using a log likelihood ratio. Rather, Hailpern et al. merely discloses the use of a 
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usage label to convey preference information. The preference information in the usage label 
consists of a usage category and a preference category. The usage category is a simple count of 
the number of times an object is referenced by a user. The preference category conveys user- 
identified preferences. In neither case does Hailpem et al. use a log likelihood ratio as recited in 
claims 34 and 93. 

U.S. Patent Application Publication No. US 2002/0013852 Al to Janik. "Svstem for providing 
Content Management, and Interactivity For Thin Client Devices" 

Janik is understood to disclose a system for delivering content, data, and application 
services to a variety of thin client devices. The system is used to provide a means for end users 
to program preference-based content for delivery at various client services, and then to 
automatically or under the control of the user, send the content to client devices for presentation 
to the end user. 

However, Janik does not teach the invention of claims 1, 34, 39, 59, or 93 and in 
particular does not teach any technique for scoring user logs, responsive to a degree of 
occurrence of at least one query item identifier in user logs. Rather, Janik provides the user with 
the ability to group audio files into u$er defined playlists. Since the playlist is user defined, it 
teaches away from a relationship discovery engine claimed in the present invention. In 
particular, in the system disclosed in Janik, the user identifies content to be delivered. Janik does 
not disclose scoring user logs, responsive to a degree of occurrence of at least one query item 
identifier in user logs as claimed herein. Furthermore, Janik fails to disclose a technique for 
determining at least one result item as claimed herein. Janik merely permits the user to group 
audio files and consequently has no need to score user logs to discover relationships or to 
determine a result item. In contrast, the present invention recommendation engine makes a 
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recommendation by determining at least one result irem responsive to a degree of occurrence in 
at least a subset of the scored user logs. 

Furthermore, with respect to claims 34 and 93, Janik does not teach any technique for 
using a log likelihood ratio. Janik does not teach any son of scoring or use of a log likelihood 
ratio since the playlists in Janik are user defined. 

U.S. Patent Application Publication No. US 2001/0044855 Al to Vermeire et al.. "System for 
Accessing Content" 

Vermeire et al. is understood to disclose a system for accessing content from the Internet 
and other computer networks using a database, a content provider interface, and a viewer 
interface. The database maps channel codes to network addresses as well as to content 
descriptions. The content provider assists content providers in entering network addresses and 
content descriptions for their information and entertainment content into the database. The 
viewer guide displays the content descriptions and a network browser allows a user to view the 
content of a channel. Additionally, the network browser creates a Favorite Channel system 
including a submenu for each genre and assigns each channel the user designates as a favorite to 
that genre submenu. 

However, Vermeire et al. does not teach the invention^of claims 1, 34, 39, 59, or 93 and 
in particular does not teach any technique for scoring user logs, responsive to a degree of 
occurrence of at least one item identifier in the user logs. Even though Vermeire et al. teaches 
the use of a Favorite Channel system, the channels in the Favorite Channel system are assigned 
by the user. The user must identify a favorite channel for the browser to include in the Favorite 
Channel system. Since such channels are user identified, Vermeire system teaches away from a 
relationship discovery engine as claimed herein. The present invention recommendation engine 
scores user logs, responsive to a degree of occurrence of at least one item identifier in the user 
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logs. Thus, the present invention implements a scoring process without requiring.the user to 
assign a score or a favorite. 

Furthermore, Vermeire et al. fails to disclose any technique for determining at least one 
result item. Venneire et al. discloses merely having a user identify a favorite. In contrast, the 
present invention recommendation engine determines at least one result item and is therefore nor 
reliant on a user identifying favorites. 

Furthermore, with respect to claims 34 and 93, Vermeire et al. does not teach any 
technique for using a log likelihood ratio. Vermeire et al. does not teach any sort of scoring or 
use of a log likelihood ratio since the system in Vermeire et al. is user defined. 

U.S. Patent Application Publication No. US 2001/0042107 A T if> Palm , "Networked Audio 
Player Transport Protocol and Architecture" 

Palm is understood to disclose a system for cornmunications using a networked 
multimedia device and a media server. A user may navigate and select a particular media item to 
be played. The user, also, can indicate user preferences such as a hierarchical list, searches and 
content provider suggestions. 

However, Palm does not teach the invention of claims 1, 34, 39, 59, or 93 and in 
particular does not disclose any technique for scoring user logs. In Palm's system a user may 
indicate preferences, but there is no scoring user logs. Palm merely permits a user to identify and 
select a playlist. Palm does not disclose any technique for scoring user logs because the system 
in Palm is user defined. 

Furthermore, Palm fails to disclose a technique for deteniuning at least one result item, 
responsive to a degree of occurrence in at least one subset of the scored user logs. The system 
disclosed in Palm permits an interactive search for specific titles using key words. It will be 
appreciated that an interactive search is not detemiining a result item responsive to a degree of 
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occurrence in at lease a subset of user logs. Additionally, Palm discloses permitting a user to 
select and identify a song or playlist. Each selection in the Palm system is a selection made by 
the user. Thus, the system disclosed in Palm teaches away from the present invention because in 
the Palm system selections are user defined- In particular, there is no teaching in Palm of scoring 



Furthermore, with respect to claims 34 and 93, Palm does not teach any technique for 



Other Claims 

Since the cited references do not disclose the claimed features discussed above, claims 1, 
34, 39, 59, and 93 are patentably distinguishable over the references. The remaining claims in 
the present application each incorporate the limitations of claims 1, 34, 39, 59, or 93, and include 
additional features and limitations. Therefore, all claims herein are patentably distinguishable 
over the cited references for at least the reasons discussed above. 

Consideration of the cited references and other information and grant of special status by 
this petition is solicited. 



user logs or detenuining result items based on the scored logs as claimed herein. 



using a log likelihood ratio. Palm does not teach any sort of scoring or use of a log likelihood 



ratio since the system in Palm is user defined. 



Respectfully submitted, 

Ted E. Dunning and Bradley D. Kindig 



Dated: March 20, 2003 




Fenwick & West LLP 
801 California Street 



Mountain View, CA 94041 



Tel.: (650)335-7276 
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